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The  Health  Opinion  Survey  in  the  Mental  Health  Clinic: 

Factor  Structure  and  Diagnostic  Relationships 

Abstract 

The  purpose  of^the  present  study  was  to  determine  the  factor  struc¬ 
ture  underlying  responses  of  psychiatric  outpatients  to  the  Health  Opinion 
Survey  (HOS)»and  assess  variations  in  those  dimensions  among  diagnostic 
subgroups.  The  sample  was  composed  of  2,168  enlisted  Navy  personnel  with 
modal  age  of  19-20  years.  Principle  components  analysis  yielded  three  inter¬ 
pretable  dimensions:  Depression,  Anxiety,  and  Somatic  Concerns.  The  salient 
variables  defining  each  component  were  itan  analyzed  to  produce  psychometric- 
ally  acceptable  subscales,  and  the  relationships  between  scores  on  the  HOS 
subscales  and  clinical  diagnosis  were  explored.  It  was  found  that,'  (fi)  there 
was  significant  variation  across  diagnoses  on  each  of  the  three  subscales; 

0)  for  each  scale  there  was  a  notable  difference  between  more  disturbed  and 
less  disturbed  outpatients j  and  (^3  there  was  consistency  in  the  relative 
scoring  positions  of  the  several  diagnostic  groups  on  HOS  subscales.  The  HOS 
dimensions  which  emerged  had  both  empirical  and  clinical  validity,  and  the 
factor  structure  associated  with  the  patient  sample  evidenced  greater  differ¬ 
entiation  than  that  previously  reported  for  nonclinical  groups.  It  was  con¬ 
cluded  that  the  HOS  subscales  have  potential  clinical  usefulness  and  warrant 
further  development  and  refinement. 
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The  Health  Opinion  Survey  in  the  Mental  Health  Clinic; 
Factor  Structure  and  Diagnostic  Relationships 


In  the  busy  ffiental  health  services  setting  there  is  a  need  for  a  rela¬ 
tively  brief,  honthreatening,  self-administered  index  of  mental  health  to  com¬ 
plement  the  usual  intake  information  related  to  background  and  current  mental 
status.  An  instrument  which  could  differentially  tap  important  clinical  fac¬ 
tors  and  provide  data  relevant  to  diagnosis  would  be  of  particular  value. 

The  development  of  this  type  of  tool  becomes  increasingly  important  as  para- 
professionals  assume  greater  responsibility  for  the  gathering  of  intake  infor¬ 
mation  in  the  clinical  setting. 

A  review  of  the  literature  suggests  the  potential  clinical  usefulness  of 
the  Health  Opinion  Survey  (HOS)  developed  by  Macmillan  (1957)  for  epidemio¬ 
logical  research.  This  instrument  has  the  advantages  of  being  brief  (20  items), 
simple  to  administer,  and  innocuous.  Further,  it  has  been  shoim  to  be  psycho- 
metzically  sound  (Butler  &  Jones,  in  press;  Jegede,  1977;  Tousignant,  Denis,  & 
Lachapelle,  1974)  and  significantly  related  to  health  status  (Butler  &  Jones, 
in  press;  Gunderson,  Arthur,  &  Wilkins,  1968;  Pugh,  Gunderson,  Erickson,  Rahe, 
i  Rubin,  1972;  Tousigtiant  et  al. ,  1974).  With  regard  to  factor  analytic  studies 
of  the  HOS  and  similar  indices,  findings  have  been  somewhat  mixed.  However, 
two  broad,  interpretable  dimensions — a  physical  symptoms  and  a  psychological 
component — have  consistently  emerged  (Butler  &  Jones,  in  press;  Gurin,  Veroff, 


&  Feld,  1960;  Phillips  &  Segal, 


1969; 
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Spiro,  Siassi,  &  Crocetti,  1972). 

Several  studies  involving  the  HOS  relate  directly  to  clinical  phenome.ia. 
For  example,  HOS  scores  have  been  found  to  distinguish  between  psychiatric 
cases  and  nonpatients  (Danley,  Note  2;  Gunderson  et  al. ,  1968;  Macmillan,  1957 
Spiro  et  al. ,  1972;  Tousignant  et  al. ,  1974).  In  addition,  total  HOS  scores 
have  been  found  to  vary  consistently  with  the  nature  and  degree  of  psychologi¬ 
cal  disturbance  (Danley,  Note  2;  Gunderson  et  al. ,  1968)  as  well  as  with  clin¬ 
ical  disposition  and  subsequent  occupational  adjustment  (Erickson,  Edwards,  & 
Gunderson,  1973;  Gunderson  et  al, ,  1968). 

It  has  been  suggested  that  the  HOS  factor  structure  for  psychiatric 
patients  may  be  somewhat  different  from  that  of  nonpatients  (Butler  &  Jones, 
in  press;  Spiro  et  al. ,  1972),  but  there  has  been  little  systematic  study  of 
this  possibility.  Thus,  there  remains  a  need  to  explore  whether  unique  dimen¬ 
sions  emerge  in  the  HOS  responses  of  diagnosed  psychiatric  patients  and  to 
assess  interrelationships  between  such  HOS  dimensions  and  specific  diagnoses. 
The  purpose  of  the  present  investigation  then  was  to  (a)  determine  the  fector 
structure  underlying  HOS  responses  obtained  from  a  large  sample  of  psychiatric 
outpatients  and  (b)  assess  variations  in  those  dimensions  among  diagnostic 
subgroups. 

Method 

Subjects 

The  sample  consisted  of  2,168  Navy  enlisted  personnel  who  were  seen  for 
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psychiatric  evaluation  at  one  of  16  Navy  outpatient  facilities  during  one 
calendar  year.  The  modal  age  was  19-20  years,  and  80%  of  the  patients  were 
in  their  first  enlistment.  The  diagnostic  categories  represented  in  the  sam¬ 
ple  included  a  wide-range  of  psychiatric  disorders;  the  largest  number  of 
cases  (52%)  were  diagnosed  as  personality  disorder. 

Procedure 

During  the  initial  consultation  period  each  patient  completed  a  brief 
qu'festionnaire  designed  to  obtain  demograohic  and  military  status  information, 
social  and  family  history,  and  the  Health  Opinion  Survey  (HOS).  The  latter 
Instrument  was  presented  in  a  Likert  format  (’’Often,”  ’’Sometimes,”  or  ’’Never"), 
with  low  scores  representing  a  greater  number  of  complaints.  Following  the 
intake  interview  the  clinician  recorded  referral  information,  data  pertaining 
to  various  attitudes  of  the  patient,  and  diagnosis.  Patients  were  grouped 
Into  eight  diagnostic  categories:  Psychosis,  Neurosis,  Transient  Situational 
Disturbance,  Personality  Disorder,  Substance  Abuse  (Alcoholism,  Drug  Abuse), 
Sexual  Deviations,  Other  Diagnoses  (Psychophysiological  Disorder,  Special 
Symptoms),  or  No  Psychiatric  Disorder. 

To  determine  the  underlying  factor  structure  of  the  HOS  responses,  a 
principal  components  analysis  was  conducted,  and  all  components  with  eigen¬ 
values  ^1.0  rotated  to  the  varimax  criterion.  Based  on  the  results  of  the 
components  analysis,  item  analytic  techniques  were  used  to  derive  scales  or 
composites  to  best  reflect  the  dimensions  produced.  The  resulting  scores 


were  subsequently  used  to  explore  relationships  between  HOS  symptom  scales  and 
psychiatric  diagnoses.  To  this  end,  patients  were  grouped  according  to  the 
psychiatric  diagnoses  indicated  above,  and  analysis  of  variance  techniques 
were  employed  to  determine  differences  in  HOS  symptom  scores. 

Results 

Principal  Components  Analysis 

The  components  analysis  of  the  HOS  item  responses  yielded  four  components 
accounting  for  45.9%  of  the  trace.  Following  varimax  rotation,  the  individual 
components  accounted  for  11.8%,  11.9%,  15.5%,  and  6.6%  of  the  original  item 
variance,  respectively.  The  20  HOS  items,  their  rotated  component  structure 
loadings,  and  item  communalities  are  shown  in  Table  1.  For  ease  of  interpre¬ 
tation,  only  loadings  ^  ±  .40  were  shown. 


Insert  Table  1  about  here. 

Three  of  the  four  components  produced  were  easily  interpreted.  The  first 
component  was  dominated  by  a  high  negative  loading  on  "feeling  in  good  spirits' 
and  a  positive  loading  on  "wondering  if  anything  is  worthwhile,"  strongly  sug¬ 
gestive  of  a  Depression  dimension.  The  second  component,  labeled  Somatic  Con¬ 
cerns  ,  reflected  concerns  about  various  aspects  of  physical  health,  including 
nonspecific  ailments  affecting  different  body  parts,  overall  state  of  physical 
well-being,  spells  of  dizziness,  and  feelings  of  general  weakness.  The  third 
component  involved  a  variety  of  specific  symptoms,  including  hand  tremors, 
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sweating,  rapid  heartbeat  (without  accompanying  physical  exertion),  and  fre¬ 
quent  nightmares.  These  symptoms  were  indicative  of  an  Anxiety  pattern.  The 
final  component  was  uniquely  defined  by  the  two  items  "Smoking"  and  "Loss  of 
appetite."  Although  these  two  items  were  significantly  intercorrelated  (r  = 
.23,  £  <  .01),  because  of  the  relatively  small  amount  of  variance  associated 
with  this  component  (6.6%)  and  its  specificity,  it  was  dropped  from  subsequent 
analyses. 

The  salient  variables  (i.e, ,  those  with  loadings  ^  ±  .40)  defining  each 
component  were  item  analyzed  to  produce  psychometrically  acceptable  HOS  sub¬ 
scales.  These  results  are  summarized  in  Tables  2  and  3.  Specifically,  Table 
2  contains  the  five  final  defining  items  for  each  scale,  their  individual 
means,  standard  deviations,  and  item- total  correlations.  Table  3  shows,  for 
each  scale,  the  means  and  standard  deviations  calculated  for  the  total  sample, 
coefficient  alphas,  and  the  average  item- total  correlation  for  all  five  defin¬ 
ing  items.  These  results  indicated  acceptable  internal  consistency  of  the 
three  scales  produced  and  justified  further  analyses. 


Insert  Tables  2  and  3  about  here. 

Diagnostic  Patterns  and  HOS  Scores 

Table  4  contains  the  means  and  standard  deviations  for  the  Somatic  Con¬ 
cerns,  Depression,  and  Anxiety  subscales  for  each  major  diagnostic  category. 
One-way  analysis  of  variance  comparisons  of  the  mean  values  for  each  subscale 
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showed  significant  between-group  variation  across  the  eight  diagnostic  groups. 
In  light  of  the  three  significant  overall  F- ratios,  several  additional,  post 
hoc  comparisons  were  made  using  Scheffe's  t  statistic.  More  specifically, 
closer  examination  of  the  mean  values  reported  in  Table  4  suggested  that 
diagnostic  groups  could  be  combined  in  terms  of  amount  of  disturbance.  Thus, 
a  more  highly  disturbed  group  (composed  of  those  diagnosed  Psychotic,  Neurotic 
Transient  Situational  Disturbance,  or  Personality  Disorder)  was  contrasted 
with  a  less  disturbed  group  (those  categorized  as  Substance  Abuse,  Sexual 
Deviation,  Other  Psychiatric  Diagnosis,  or  No  Psychiatric  Diagnosis)  in  order 
to  assess  differences  in  scoring  patterns.  For  each  of  these  comparisons, 
significant  differences  were  found  (Somatic  Concerns,  t  =  9.21,  £  <  .01; 
Depression,  t  =  10.32,  jo  <  .01;  Anxiety,  t  =  12.95,  jg  <  .01).  Finally,  no 
significant  differences  among  mean  values  were  found  within  the  two  categories 
of  disturbance. 


Insert  Table  4  about  here. 

To  illustrate  the  extent  to  which  there  was  consistency  among  diagnostic 
subgroups  in  terms  of  their  positions  on  the  three  HOS  subscales,  the  scoring 
pattern  is  graphically  presented  in  Figure  1.  It  is  clear  that  the  more 
pathognomic  values  (i.e. ,  lower  scores)  were  repeatedly  found  among  the  psy¬ 
chotic  group,  whereas  the  highest  scores  were  consistently  observed  in  the 
sexual  deviation  group.  The  relative  placement  of  the  several  diagnoses 
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according  to  HOS  score  was  suggestive  of  an  ordering  or  continuum  of  psychi¬ 
atric  disturbance.  The  degree  to  which  there  was  reliability  in  such  an 
ordering  across  subscales  was  reflected  in  the  significant  coefficient  of  con¬ 
cordance  (W  =  .94,  average  rg  =.91,  £<  .01). 


Insert  Figure  1  about  here. 

Discussion 

The  discussion  is  organized  around  the  two  major  goals  of  the  study, 
namely,  (a)  the  determination  of  the  factor  structure  underlying  HOS  responses 
of  psychiatric  outpatients  and  (b)  the  assessment  of  variations  in  HOS  pat¬ 
terns  across  diagnostic  groups.  First,  the  results  of  the  components  analysis 
clearly  revealed  the  presence  of  three  interpretable  major  dimensions:  Somat¬ 
ic  Concerns,  Depression,  and  Arociety.  This  finding  supports  the  idea  of 
multidimensionality  in  the  HOS  and  related  indices  (e.g. ,  Butler  &  Jones,  in 
press;  Gurin  et  al. ,  1960;  Seiler,  1973;  Spiro  et  al. ,  1972),  but  its  impor¬ 
tance  is  more  evident  if  considered  in  relation  to  previously  reported  find¬ 
ings. 

Most  investigators  have  concluded  that  the  HOS  is  basically  composed  of 
two  subscales,  a  physical  and  a  psychological  dimension.  Subjects  in  such 
studies  were  typically  drawn  from  a  nonclinical  setting i  The  results  of  the 
present  study  were  notable  in  that  for  psychiatric  outpatients  there  were  two 
distinct  psychological  components  (Depression  and  Anxiety)  in  addition  to  a 
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dimension  reflecting  physical  concerns.  Thus,  there  is  greater  differentia¬ 
tion  of  the  psychological  component  among  patients  than  in  nonclinical  groups, 
A  somewhat  similar  pattern  was  found  in  a  preliminary  study  which  involved 
only  30  psychiatric  patients  (Spiro  et  al.,  1972),  and  Butler  and  Jones  (in 
press)  earlier  had  speculated  about  the  possibility  of  greater  factor  complex¬ 
ity  among  psychiatric  patient  groups. 

From  a  clinical  perspective,  the  three  factors  which  emerged  in  the  HOS 
response  pattern  are  consistent  with  symptomatology  frequently  observed  in 
the  mental  health  setting.  Common  features  among  psychiatric  patients  are 
those  of  somaticization  of  fears  or  conflicts,  discouragement  and  depression, 
and  tension  and  anxiety.  Although  these  ’’themes”  often  occur  in  combination 
(e.g. ,  depressive  neurosis),  one  of  the  features  usually  predominates.  Clin¬ 
ically,  then,  the  three  HOS  components  have  a  certain  degree  of  validity. 

With  regard  to  the  relationship  between  HOS  scoring  patterns  and  psychi¬ 
atric  diagnosis,  several  points  are  noteworthy.  First,  there  was  significant 
variation  across  diagnoses  on  each  of  the  three  HOS  subscales.  Furthermore, 
for  each  scale  there  was  a  notable  difference  between  outpatients  whose  diag¬ 
nosis  implied  a  more  severe  psychological  disturbance  and  those  who  were  less 
disturbed.  Finally,  there  was  consistency  in  the  relative  positions  of  the 
several  diagnostic  groups  on  HOS  subscales. 

Although  previous  investigators  anticipated  the  possibility  of  differen¬ 
tial  HOS  response  patterns  and  intensities  for  various  diagnostic  groups  (e.g.. 


Gunderson  et  al. ,  1968),  results  have  been  equivocal  in  research  bearing  upon 
the  extent  to  which  the  }10S  and  related  instruments  could  detect  degrees  of 
psychological  disturbance.  Both  Dohrenwend  and  Crandell  (1970)  and  Seiler 
(1973)  asserted  that  such  scales  could  not  be  used  to  rank  order  the  degree 
of  mental  illness,  whereas  other  investigators  have  concluded  that  degrees  of 
psychological  impairment  can  be  differentiated  by  those  symptom  check-lists 
(Danley,  Note  2;  Gunderson  et  al. ,  1968;  Manis,  1964).  The  results  of  the 
present  study  suggest  that  HOS  subscale  score  patterns  are  related  to  the 
extent  and  type  of  psychological  disturbance,  indicating  the  possible  useful¬ 
ness  of  this  type  of  instrument  in  the  mental  health  setting.  Additional 
research  is  needed  in  order  to  gain  understanding  of  the  relationships  between 
HOS  patterns  and  other  clinically  salient  features  and  decisions  (e.g.,  mental 
status,  treatment  recommendations,  treatment  motivation,  and  disposition)  and 
to  allow  further  refinement  of  the  instrument. 

In  light  of  the  tendency  for  the  several  diagnostic  groups  to  maintain 
their  relative  scoring  positions  across  HOS  subscales,  note  was  taken  of  the 
exception  to  the  pattern  found  among  the  patients  in  the  "Other  Psychiatric 
Diagnosis"  category.  This  group  had  the  second  mildest  scores  on  both  psycho¬ 
logical  subscales,  but  moved  toward  a  position  suggestive  of  more  disturbance 
on  the  Somatic  Concerns  factor.  Closer  analysis  of  the  composition  of  the 
"Other"  patient  group  revealed  that  46?o  carried  a  diagnosis  which  clearly 
involved  a  physical  component  (e.g.,  Psychophysiological  Disorder,  Cephalal¬ 
gia,  or  Other  Psychomotor  Disorder).  Such  observations  lend  further  validity 
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to  the  HOS  subscales  and  reinforce  the  idea  that  these  scales  should  prove 
clinically  useful  with  further  development. 

Another  finding  that  warrants  mention  is  the  consistency  with  which  those 
in  the  Sexual  Deviation  category  obtained  HOS  scores  suggestive  of  a  symptom- 
free  status.  One  inference  might  be  that  such  patients  were  the  least  dis¬ 
turbed  among  the  several  diagnostic  groups,  including  those  assessed  as  having 
no  psychiatric  disorder.  However,  clinical  observations  of  this  group  suggest 
that  some  have  been  apprehended  by  military  authorities  and  wish  to  leave  the 
military-  service  as  soon  as  possible  but  deny  any  significant  personal  prob¬ 
lems. 

Future  research  should  extend  the  investigation  of  the  HOS  factors  in 
both  clinical  and  nonclinical  populations.  It  would  be  fruitful,  for  example, 
to  systematically  determine  the  validity  of  the  Anxiety  factor  in  terms  of 
other  indicators  of  anxiety,  both  clinical  ratings  and  other  self-report 
measures  (e.g.,  the  Taylor  Manifest  Anxiety  Scale).  Similar  approaches  could 
be  used  in  assessing  the  validity  of  the  Depression  and  Somatic  Concerns 
scales.  Attention  should  also  be  given  to  the  relationships  betvveen  HOS 
scoring  patterns  and  additional  variables  of  clinical  importance  such  as  men¬ 
tal  status,  disposition,  prognosis,  and  subsequent  occupational  adjustment. 

The  results  of  such  research  would  provide  further  evidence  concerning  the 
potential  usefulness  of  the  HOS  in  the  mental  health  clinic  setting. 
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Table  1 


Rotated  Component  Structure  Loadings  of 
Health  Opinion  Survey  Responses 

Rotated  Component  Structure  Loadings^ 


Item 

I 

II 

III 

IV 

h2 

1.  Do  you  have  any  physical  or  health 
problems  at  the  present? 

-.60 

.39 

2.  Do  your  hands  ever  tremble  enough  to 
bother  you? 

.53 

.46 

3.  Are  you  ever  troubled  by  your  hands 
or  feet  sweating  so  that  they  feel 
damp  and  clammy? 

.65 

.46 

4.  Have  you  ever  been  bothered  by  your 
heart  beating  hard? 

.57 

.44 

5.  Do  you  tend  to  feel  tired  in  the 
morning? 

.48 

.39 

6.  Do  you  have  any  trouble  getting  to 
sleep  and  staying  asleep? 

.54 

.42 

.49 

7.  How  often  are  you  bothered  by  having 
an  upset  stomach? 

.47 

.32 

8.  Are  you  ever  bothered  by  nightmares? 

.51 

.44 

9.  Have  you  ever  been  troubled  by  ’’cold 
sweats”? 

.56 

.41 

10.  Do  you  feel  that  you  are  bothered  by 
all  sorts  of  ailments  in  different 
parts  of  your  body? 

-.61 

.45 

11.  Do  you  smoke? 

.84 

.72 

12.  Do  you  ever  have  loss  of  appetite? 

.45 

.40 

.48 

*Only  loadings  ^  ±.40  are  reported. 


Item 


Rotated  Component  Structure  Loadings 


Item 

II 

III 

h2 

13. 

Has  any  ill  health  affected  the 
amount  of  work  you  do  at  home 
or  on  the  job? 

-.59 

.42 

14. 

Do  you  ever  feel  weak  all  over? 

-.46 

.44 

.49 

15. 

Do  you  ever  have  spells  of  dizziness? 

-.48 

.43 

.47 

16. 

Do  you  tend  to  lose  weight  when  you 
worry? 

.32 

17. 

Have  you  ever  been  bothered  by  short¬ 
ness  of  breath  when  you  are  not 
exerting  yourself? 

-.43 

.44 

18. 

For  the  most  part,  do  you  feel  healthy 
enough  to  carry  out  the  things  you 
would  like  to  do? 

.59 

.54 

19. 

Do  you  feel  in  good  spirits?  -.73 

.58 

20. 

Do  you  sometimes  wonder  if  anything 

is  worthwhile  anymore?  .65 

.45 

Table  2 


Results  of  Item  Analysis  of  Salient  Variables  Defining 
Depression,  Somatic  Concerns,  and  Anxiety  Subscales® 


Item 

Mean 

S.D. 

Depression; 

Do  you  tend  to  feel  tired  in  the  morning? 

1.72 

.66 

Do  you  have  trouble  getting  to  sleep  and  staying 
asleep? 

1.85 

.75 

Do  you  ever  have  loss  of  appetite? 

1.96 

.66 

Do  you  feel  in  good  spirits?  (Reverse  scored) 

2.26 

.60 

Do  you  sometimes  wonder  if  an3rthing  is  worth¬ 
while  anymore? 

1.74 

.68 

Somatic  Concerns: 


Do  you  ever  feel  that  you  are  bothered  by  all 
sorts  of  ailments  in  different  parts  of  your 


body? 

2.64 

.56 

Has  any  ill  health  affected  the  amount  of  work 
you  do  at  home  or  on  the  job? 

2.47 

.63 

Do  you  ever  feel  weak  all  over? 

2.25 

.62 

Do  3«)u  ever  have  spells  of  dizziness? 

2.39 

.64 

Have  you  ever  been  bothered  by  shortness  of 
.  breath  when  not  exerting  yourself? 

2.56 

.62 

Anxiety: 

Do  your  hands  ever  tremble  enough  to  bother  you? 

2.19 

.65 

Are  you  ever  troubled  by  your  hands  or  feet 
sweating  so  that  tliey  feel  damp  and  clammy? 

2.11 

.71 

*N  =  2,168}  possible  score  range,  S-IS. 
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Item 

Mean 

S.D. 

£it 

Anxiety:  (continued) 

Have  you  ever  been  bothered  by  your  heart  beating 
hard? 

2.32 

.67 

.45 

Are  you  ever  bothered  by  nightmares? 

2.34 

.69 

.42 

Are  you  ever  bothered  by  nightmares? 

Have  you  ever  been  troubled  by  "cold  sweats"? 


2.58 


.57 


.46 


Table  3 


Psychometric  Characteristics  of  HOS  Subscales: 
Depression,  Somatic  Concerns,  Anxiety® 


Scale 

Mean 

S.D. 

Coefficient 

Alpha 

Average 

rit 

Depression 

9.53 

2.28 

.71 

.47 

Somatic  Concerns 

12.30 

2.12 

.73 

« 

NO 

Anxiety 

11.54 

2.23 

.71 

.47 

=  2,168.  Number  of  items  in  each  scale  =  5;  possible  score 
range  =  5-15,  All  scales  were  scored  so  that  higher  scores 
indicated  fewer  symptoms  reported. 


Means  and  Standard  Deviations  of  HOS  Subscales  for  Each  Diagnostic  Group 


Figutc  1.  Avcnj^c  Scores  of  Diagnostic  Groups  on  HOS  Subtcalet 
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